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Functional health literacy (FHL) involves skills in writing, reading, oral 
expression, comprehension, and numerical calculations to successfully 
function and complete health-related tasks. This study aimed to develop and 
validate an instrument for measuring FHL in the Philippines using a mixed- 
method design. FHL-5TEST is an instrument consisting of five questions 
developed in consultation with local experts, translated to major Philippine 
languages, and underwent translation analysis, pretesting, cultural 
adaptation, and validation. A cross-sectional study was conducted in a 
random sample of 15-70-year-old Filipino residents to validate the 
instrument. The FHL-STEST demonstrated high internal consistency, with a 
Cronbach’s alpha of 0.7690. Across different cut-off values, the sensitivity 
and specificity of the instrument in detecting limited FHL ranged from 
60.9% to 86.0% and from 61.6% to 97.2%, respectively. The study 


demonstrated that the FHL-5TEST is a valid and reliable instrument to 
measure functional health literacy in the Philippines. 
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1. INTRODUCTION 

Health literacy is broadly defined as the “knowledge, motivation, and competencies to access, 
understand, appraise, and apply health information in order to make judgments and take decisions concerning 
health care, disease prevention, and health promotion” [1]. Its close link with utilization of health services 
and health outcomes has drawn recognition to its importance in health care [2], [3]. Low health literacy has 
been shown to be associated with poor health-related knowledge [4], high-risk health behaviors [5], [6], 
underuse of preventive services [7], increased hospitalizations [8], more health care expenditures [9], and 
higher mortality risk [8]. 

Health literacy is a complex and evolving concept encompassing different cognitive and social 
skills [10]. This spectrum of relevant skills can be categorized into multiple types of health literacy, one of 
which is functional health literacy [2]. Functional health literacy (FHL) involves skills in writing, reading, 
oral expression, comprehension, and numerical calculations so as to successfully function and complete 
health-related tasks [11]. FHL enables transmission of information and facilitates engagement, autonomy, 
and empowerment in health-related settings [12]. FHL has three domains: prose literacy, document literacy, 
and numeracy [10]. Prose literacy is needed to understand and use information from sentences or paragraphs, 
while document literacy is needed to locate and use information from noncontinuous texts in various formats. 
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Lastly, numeracy corresponds to identifying and performing computations using numbers from printed 
materials [13]. 

The increasing attention on the importance of FHL warrants an instrument to accurately measure 
FHL in order to facilitate health literacy interventions when needed. Various instruments have been 
developed to measure FHL, such as the test of functional health literacy in adults (TOFHLA), the rapid 
estimate of adult literacy in medicine (REALM), and the newest vital sign (NVS). NVS is a brief instrument 
that can assess prose literacy, document literacy, and numeracy and can be administered in about three 
minutes [14]. It contains six questions based on an ice cream nutrition label, wherein each correct response is 
given one point. A score of 4-6 indicates adequate health literacy, while a score of 0-3 suggests limited health 
literacy. Its quick and accurate assessment of FHL led to its adaptation and utilization in several 
countries [7], [15]-[18] and application in primary care clinics [19], hospitals [7], and communities [15]. 

Ideally, measurement tools should be specific to the population to account for cultural and 
institutional differences. Localized instruments for measuring FHL have been developed and validated in 
other countries [20]-[23]. The instruments covered different health topics depending on relevance to the 
target population. However, while instruments for measuring general health literacy have recently been 
validated in the Philippines [24], [25], no such instrument for FHL has been developed yet in the country 
based on a review of available literature. In the absence of a localized instrument, FHL cannot be accurately 
identified to enable implemention of tailored interventions [23], [26]. Further, a locally validated instrument 
is needed to produce accurate population estimates of the local magnitude of limited FHL that can support 
evidence-based health policy and programs for improving FHL [27], [28]. This study aimed to develop and 
validate an instrument for measuring FHL in the Philippines that is adapted to local context using a health 
topic widely familiar within the population. 


2. RESEARCH METHOD 

This study was part of the national health literacy survey (NHLS) conducted in 2018, which had a 
general objective of describing the level of health literacy of Filipinos aged 15 to 70 years old. A mixed- 
method design was employed for this study, with qualitative methods for the development of the instrument 
and quantitative methods for the validation of the instrament. The main steps in the methodology for this 
study is illustrated in Figure 1. 
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Figure 1. Process of developing and validating the local version of FHL instrument 
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2.1. Development and translation of FHL instrument 

An expert panel consisting of public health practitioners and specialists in health promotion and in 
health literacy developed a local version of an instrument to measure FHL patterned on the newest vital sign, 
with questions based on a specific health education material. This was conducted through a workshop and the 
output was the first version of the instrument. Content validity of the instrument was examined by 
determining whether the questions covered the three domains of FHL. 

The instrument underwent forward and backward translation to seven major Philippine languages. 
Forward translation to each language was done by the Commission on Philippine Languages, while backward 
translation of each version to English was done by native speakers of each respective language. This was 
followed by translation analysis using the scheme developed by Hall et al. [29] to assess semantic 
equivalence between the original and back-translated versions and ensure that the original meaning was not 
lost in translation. Items assessed as having no agreement were modified at the local level with local 
language experts. 


2.2. Pretesting and cultural adaptation 

One city or municipality was randomly selected in areas that speak each language to which the 
instrument was translated. In each sampled location, a focus group discussion (FGD) was conducted to assess 
the clarity and cultural appropriateness of the instrument and refine specific items as needed. Participants of 
each FGD included 8-12 residents of the selected city or municipality, one local expert in research methods, 
and one local language expert. 


2.3. Validation study 

A cross-sectional study was employed to validate the instrument among Filipino residents 15 to 70 
years old using the newest vital sign (NVS) as the reference test [14]. NVS is a brief instrument that can 
assess prose literacy, document literacy, and numeracy. It contains six questions based on an ice cream 
nutrition label, wherein each correct response is given one point. The validation process took place during the 
pilot testing of the national health literacy survey (NHLS). 


2.4. Sampling method and sample size 

Respondents were recruited from the NHLS study sites which were selected using multiple-stage 
random sampling. The sampling methodology for NHLS has been previously described in another paper [25]. 
Specific barangays (the smallest political unit in the Philippines) were randomly selected to represent areas 
that speak each language the instrument was translated and adapted to. Households were randomly chosen in 
each barangay and one respondent was randomly selected from among the eligible members of the 
household. Exclusion criteria included being illiterate, having self-reported poor vision, having prior 
knowledge of the information in the health education material from memory, and having cognitive 
impairment determined using Mini-Cog© administered during recruitment. The recommended sample size in 
validation studies is to use a respondent-to-item ratio of at least 10:1, with an absolute minimum of 100 
respondents [30], [31]. For this study, a total of 240 residents were recruited from eight barangays. 


2.5. Data collection 

Individual interviews were carried out using the Computer-Assisted Personal Interviewing (CAPI) 
method in December 2018. Informed consent was obtained from each respondent prior to participation in the 
validation of the FHL-5TEST. Demographic information, including sex, age, marital status, religion, 
educational attainment, and occupation, were collected. Afterwards, the newly developed instrument (FHL- 
STEST) and the reference instrument (NVS) were administered. Data collectors were trained in the 
administration of the newly developed instrument and carried with them the 1-page protocol for 
administering the instrument. 


2.6. Data analysis 

The collected data were initially processed in Microsoft Excel® 2010 and were subsequently 
analyzed using Stata® 12 IC version. Categorical variables were presented using frequencies and 
proportions, while numerical variables were presented using mean and standard deviation as appropriate. 
Analyses were conducted to describe the reliability and validity of the FHL-STEST, including Cronbach’s 
alpha to estimate the internal consistency of items and Spearman’s rank correlation between the FHL-STEST 
score and NVS score. In addition, sensitivity, specificity, and areas under the receiver operating characteristic 
curve (AUC) were computed with the corresponding 95% confidence intervals to determine the ability of 
FHL-STEST to correctly classify people as with adequate or with limited functional health literacy using 
NVS as the reference test. The NVS instrument categorizes FHL level into adequate (score of 4-6) and 
limited (score of 0-3). 
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2.7. Ethics clearance 

The study was granted technical clearance by the Philippine Statistics Authority and the Philippine 
Council for Health Research and Development (DOH-1840) and was given ethics clearance by the National 
Ethics Committee (NEC Code:2018-013 Tolabing-Literacy). Participation in the study was voluntary and 
written informed consent was obtained from individuals who signified their agreement to participate in the 
study. For minors (15-17 years old), assent was obtained in addition to the consent signed by the parents. 


3. RESULTS AND DISCUSSION 
3.1. Development, translation, pretesting, and cultural adaptation 

FHL-STEST was developed as an instrument to measure functional health literacy in the Philippines 
based on a health education material of an immunization schedule created by the Philippine Department of 
Health as shown in Figure 2 [32]. Vaccination was selected as the subject matter of the instrument since 
vaccination is one of the most common health services utilized in the country. The instrument consisted of 
five test items which the respondents answered while referring to the immunization schedule that was handed 
to them: i) Which vaccines may be given to infants immediately after birth?; 11) How many types of vaccines 
should have been received by a child who is one year old?; iii) In total, how many doses of all the 
recommended vaccines should be given to infants?; iv) Which vaccine(s) can protect against pneumonia?; v) 
Assume that you have a child who was born on January 1, 2017, when should he/she receive the first dose of 
the measles-mumps-rubella (MMR) vaccine? 

Each item is scored “1” for correct answer and “0” for incorrect answer. The total score may range 
from 0 to 5, with higher scores indicating higher FHL. The questions were constructed to test the FHL skills 
of prose literacy, document literacy, and numeracy. Numeracy is measured by items 2, 3, and 5; prose 
literacy is assessed by item 5, while document literacy is incorporated in all items. During instrument 
development, experts carefully considered the relevance and comprehensiveness of the items as these were 
being constructed [33]. 


Schedule ng Pagbibigay ng Ba kun a rR 
para sa mga Batang Isang Taon P. a iH ASÈ « 


MANIGURADO. 
| MAGPABAKUWA 
row Kump ws 


—— 
SAKIT NA e ‘Pag Kumpleto Protektado, 
MAIIWASAN 
MGA PAALALA 
Tuberkulosis (TB) 
7 i PE EAT, 
HEPATITIS B Hepatitis B ng bata sa kapanganakan. 
PENTAVALENT VACCINE Dipterya, Tetana, Hepa B, F Sundin ang schedule ng 
(DPT-Hep B-HiB) sais a aa bakuna at siguruhing 
ORAL POLIO VACCINE > 
0P) Polio 
INACTIVATED POLIO Polio 
VACCINE (PV) : Ang mga bakunang hindi 
PNEUMOCOCCAL are nakalista ay maaring makuha 
CONJUGATE VACCINE (Pa) | Pulmonya, Meningitis sa pribadong ospital o doktor. 


MEASLES, MUMPS, Tigdas, Beke, Itago bilang 
RUBELLA (MMR) German Measles bs ste rae 


Figure 2. Health education material used for the FHL5-TEST [32] 


The Figure 2 describes the schedule of routine immunization for infants according to the age of the 
child when each vaccine should be administered. A similar version of this immunization schedule table in 
English is available elsewhere [34]. The multi-step process of translation was designed to maintain the 
faithfulness of different language versions to the original without substantial change in the meaning and 
difficulty of the items. Across several language translations of the instrument, majority of the items were 
classified as having good semantic equivalence between the original and the backtranslated versions as 
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shown in Table 1. Only the Ilocano language version had two items assessed as having no agreement at all. 


Items assessed as having no agreement underwent an iterative process of forward and backward translation 
until all items preserved the meaning of the original version. 


Table 1. Semantic equivalence of the back-translated and source versions of the FHL-STEST 


Rating on semantic Number of items under each rating (out of total 5 items) 
equivalence! Bicolano Filipino Hiligaynon Ilocano Kapampangan Sebuano Waray 
A 1 1 1 1 1 2 4 
B 1 3 2 1 3 2 0 
C 2 1 1 1 0 1 0 
D 1 0 1 2 1 0 1 


1A- perfect semantic equivalence and good literal and semantic parallels between the back-translated and source versions; B - 
satisfactory semantic equivalence but have one or two different words; C- meaning of the original has been preserved but without a 
satisfactory semantic equivalence; and D- no agreement. 


In the majority of language versions, all items were deemed clear and culturally appropriate and 
were retained as they did not require further revision. For Waray, Bisaya, and Hiligaynon language versions, 
one to two items were modified for clarity and cultural sensitivity. No major challenges were identified in 
administering and in answering the instrument during the pretesting phase. Pretesting and cultural adaptation 
were done to establish the conformity to local usage and context. These phases were essential to maximize 
the quality and comparability of data from an instrument applied across varying languages and cultures [35]. 


3.2. Validity and reliability measures 

Evidence for validity of research instruments include content validity, face validity, construct 
validity, and criterion validity [36]. Content validity, referring to the extent to which items in an instrument 
are reflective of the content universe it is supposed to measure, was ensured during the development of the 
instrument through extensive literature review and expert panel consultations. Meanwhile, face validity as the 
subjective judgment of non-experts on the presentation and relevance of the instrument was examined 
through focus group discussions during the pretesting [36]. 

A total of 215 participants were included in the validation study after applying the inclusion and 
exclusion criteria. Majority were females, between ages 15-35 years, and had no occupation. Using the FHL 
reference test (NVS), 83.3% of the respondents were classified as having limited FHL as revealed in Table 2. 


Table 2. Characteristics of the respondents (n=215) 


Variable Freq. _ Percent 

Age group (n=209) 

15-35 years 105 50.24 

36-60 years 82 39.23 

61-70 years 22 10.53 
Sex 

Male 62 28.84 

Female 153 71.16 
Educational attainment (n=212) 

Primary school level 20 9.43 

High school level 81 38.21 

Senior high/vocational 32 15.09 

College level 79 37.26 
Type of occupation (n=214) 

None 129 60.28 

Managerial/Professional 18 8.41 

Others 67 31.31 
FHL classification using NVS 

Limited 179 83.26 

Adequate 36 16.74 


The distributions of scores using the FHL-STEST and the NVS are shown in Table 3. Using FHL- 
STEST, the mean score was 2.57 (+1.77), while the median score was 2. The proportions in each score 
ranged from 13-22%, with a perfect score (5 out of 5 items correct) being the most frequent. In comparison, 
using NVS, the mean score was 1.62 (+1.60), while the median score was 1. The most frequent score was 
having zero correct items. 
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Table 3. Distribution of participants according to total FHL scores obtained using FHL-STEST and NVS 
Total FHL score obtained FHL-STEST NVS 


Score n % n % 
0 36 16.7 76 35.4 
1 32 149 36 16.7 
2 42 195 46 214 
3 30 1440 21 98 
4 28 13.0 24 11.2 
5 47 21.9 10 4.7 
6 2 0.9 


Among the five items of FHL-5TEST, item 4 was the most correctly answered, whereas item 2 
was the least correctly answered as displayed in Table 4. Reliability of the FHL-S5STEST was assessed in 
terms of internal consistency, which is concerned with the similarity of items in measuring the same 
construct [37]. FHL-STEST was demonstrated to have high internal consistency, with a Cronbach’s alpha of 
0.769, supporting that the five items were all measuring the same construct of FHL level. This was higher 
compared to the observed internal consistency when any of the items is removed as shown in Table 4. Thus, 
the instrument was retained as a 5-item questionnaire. 


Table 4. Proportion of correct answers and internal consistency of items 


FHL-STEST item Hape Cronbach’s alpha when item is removed 
‘0 
1. Which vaccines may be given to infants immediately after birth? 110 51.2 0.709 
2: How many types of vaccines should have been received by a child who 81 377 0.759 
is one year old? 
3; In total, how many doses of all the recommended vaccines should be 95 442 0.707 
given to infants? 
4. Which vaccine(s) can protect against pneumonia? 140 65.1 0.759 
5. Assume that you have a child who was born on January 1, 2017, when 
should he/she receive the first dose of the measles-mumps-rubella 127 59.1 0.694 
(MMR) vaccine? 
Cronbach’s alpha of FHL-STEST 0.769 


Criterion validity is concerned with the extent to which a measure is related to an outcome. One way 
of demonstrating this is through correspondence between the test and a previously established measure for 
the same construct [36]. The results showed that the FHL-STEST score was moderately correlated with the 
NVS score (Spearman's rho=0.457, p-value<0.0001). 

Three cut-off values were explored for classifying a respondent as having limited FHL—having a 
score below 60%, 80%, or 100%. The classifications of respondents with limited and adequate FHL 
according to NVS and FHL-5TEST using different cut-off values are shown in Table 5. The corresponding 
sensitivity and specificity values for detecting a respondent with limited FHL using NVS classification as the 
reference test are shown in Table 6. A cut-off value of 100% resulted in the highest sensitivity, wherein 86% 
of those with limited FHL based on NVS were similarly classified as having limited FHL (95% CI: 0.801- 
0.908). Meanwhile, a cut-off value of 60% resulted in the highest specificity, wherein 97% of those classified 
as having adequate FHL based on NVS were similarly classified as having adequate FHL. Among the three 
values, a cut-off score of 60% resulted in the highest area under the receiver operating characteristic curve 
(AUC=0.796, 95% CI: 0.746-0.836). Using NVS category as the reference, the analysis revealed that the 
cutoff scores of 60%, 80%, and 100% all had acceptable performance in discriminating between populations 
with adequate and limited FHL [38]. 

Researchers intending to use the FHL-5TEST should then select the most appropriate cutoff score 
based on the objective of their studies. The cut-off score of 60% showed the greatest area under the curve, 
with high specificity of 97.2% (2.8% false positive) but low sensitivity of 60.9% (39.1% false negative). 
Since it demonstrated the best discriminatory property, it may be the most optimal for prevalence surveys. 
However, this cut-off may miss to identify a substantial proportion of individuals with limited FHL—with as 
high as 39.1% being misclassified as having adequate FHL (i.e. false negatives). Misclassifying those with 
limited FHL as having adequate FHL is considered more serious than incorrectly labelling those with 
adequate FHL as having limited FHL (i.e. false positives) due to the significant burden of having limited 
FHL on the individual and on the health care system [8], [9]. 
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Table 5. Distribution of participants according to FHL level using NVS and using different cut-off points of 
the FHL-STEST 
NVS classification 
FHL-5TEST Cut-off points Limited (n=179) Adequate (n=36) 
n Column% n Column% 


FHL-STEST 60% 


Limited 109 60.9 1 2.8 
Adequate 70 39.1 35 97.2 
FHL-5TEST 80% 
Limited 133 74.3 7 19.4 
Adequate 46 25.7 29 80.6 
FHL-S5TEST 100% 
Limited 154 86.0 14 38.9 
Adequate 25 14.0 22, 61.1 


Table 6. Comparison of the areas under the curve, sensitivity, and specificity of different cut-off points of the 


FHL-STEST 
Cut-off point n Area under the curve 95% CI Sensitivity 95% CI Specificity 95% CI 
60% 215 0.791 0.746-0.836 0.609 0.533-0.681 0.972 0.855-0.999 
80% 215 0.774 0.701-0.847 0.743 0.672-0.805, 0.806 0.640-0.918 
100% 215 0.736 0.65 1-0.820 0.860 0.801-0.908 0.611 0.435-0.769 


Among the three cut-off scores, the score of 100% was able to identify the most number of 
individuals with limited FHL. Although it did not exhibit the highest overall diagnostic accuracy, it 
minimized the proportion of those with limited FHL incorrectly classified as having adequate FHL. This cut- 
off score may be more useful for FHL intervention studies based on a reasonable assumption that more 
individuals with limited FHL would better gain an opportunity to improve their FHL levels. Moreover, health 
literacy interventions are not expected to pose significant adverse consequences to those with adequate FHL 
if they are erroneously labelled to have limited FHL. Ultimately, the relative importance attributed to false- 
positive and false-negative results should direct the choice of cut-off score [39]. 

The observed validity measures for FHL-STEST were comparable to previous instruments. NVS, 
the reference test used in this study, was reported to have an area under the curve (AUC) of 0.88 (95% CI, 
0.84-0.93; p<0.001), a sensitivity of 100% and a specificity of 64% for predicting limited FHL using 
TOFHLA as the reference test [14]. Other instruments developed to measure FHL used NVS or TOFHLA as 
the reference test and reported a range of values for AUC (0.65-0.80), sensitivity (18%-81%), and specificity 
(62%-94%) [40]-[42]. Majority of instruments previously developed had a higher number of items [23], 
which will take a longer time to administer. The FHL-STEST was developed with only five items so that it 
can be administered in a short amount of time, allowing ease of use in different types of settings, including 
clinical and research settings. 

Half of the participants in this study population scored lower than 60% using the FHL-STEST, while 
a high proportion was assessed to have limited health literacy using NVS, indicating potential floor effects. 
Floor or ceiling effects exist in an instrument if a high proportion of the respondents obtained the lowest or 
highest possible scores, respectively [43]. Validation of the NVS in North America found no significant floor 
effect (6.8% with a score of zero) [14]. In contrast, using NVS among the study respondents revealed a 
marked floor effect (35.4% with a score of zero), as opposed to using the FHL-5TEST in which the 
distribution of scores was more spread out. A high floor or ceiling effect may lead to a reduced ability of the 
instrument to differentiate respondents from each other and to detect changes in FHL among respondents at 
the end of the score range [43]. One explanation for the result of NVS in this study may be the less 
familiarity of Filipinos to nutrition labels which are the material used in NVS [44]. A national survey 
reported that only 53.6% of the Filipino adult population read product labels, and of these, only 19.9% read 
the nutrition facts [45]. This proportion is notably lower than those reported in other countries [46]-[48]. It 
further highlights the challenges in using instruments validated in other countries, and the importance of 
considering local context and culture when developing or adapting instruments to measure health literacy 
level more accurately and implement responsive interventions accordingly. 

The strengths of this study are the following: firstly, the translation process was rigorous and 
included translation analysis that ensured semantic equivalence of the original and the back-translated 
versions; and secondly, possible influence of prior knowledge about immunization in the assessment of FHL 
was addressed by excluding those with prior knowledge about the concepts covered in the FHL-STEST. This 
study, however, had several limitations. The data for the validation of FHL-STEST was collected during the 
pilot-testing phase of the NHLS, during which the main objective was to finalize the instruments and 
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methods for NHLS. The sample selection during this phase was not designed to be representative of the 
population of the Philippines, and it may have affected the demographic distribution of the study population. 
Therefore, the estimates of FHL level reported in this study may not be generalizable to the whole country. 
The results pertaining to the validation of the instrument do not require a random sample and thus may still 
be utilized and interpreted. In the administration of instruments during data collection, the respondents 
always answered the FHL-5TEST first and the NVS second. Hence, it is possible that the participants may 
have become fatigued by the time the NVS was administered, potentially leading to poor performance on the 
NVS. However, the data collectors were trained to give the participants sufficient breaks as needed during the 
interview to avoid this, and as such, this is not expected to have influenced the result significantly. 


4. CONCLUSION 

The FHL-STEST is the first locally developed and validated instrument to measure FHL. It consists 
of five questions based on an immunization schedule flyer. In comparison to the reference test (NVS), FHL- 
STEST was observed to have acceptable sensitivity and specificity in detecting limited functional health 
literacy. The study demonstrated that the FHL-S5TEST is a potential valid and reliable instrument that can be 
used to measure functional health literacy in the Philippines. The instrument is short and can be administered 
quickly, so it can be used to measure FHL in different settings. It also has the added benefit of reminding 
individuals of the importance and the timeline of childhood vaccination that may subtly promote vaccine 
uptake. Future studies may seek an external review of the instrument translation and adaptation, consider 
standardizing scores across cultures, and assess other aspects of the instrument, including the duration of 
administration. Further research may include information on health outcomes to provide additional evidence 
of validity of the FHL-STEST in measuring FHL, to identify the most appropriate cut-off score to use in 
classifying FHL level, and to determine utility in primary care clinics and hospitals. 


ACKNOWLEDGEMENTS 

This work received financial support from the Department Of Health (DOH) of Philippines. This 
article reflects the points of view and thoughts of the authors, and the information, conclusions, and 
recommendations presented are not to be construed as those of the DOH nor of the Philippine Council for 
Health Research and Development. The material presented here, however, is done in the spirit of promoting 
open access and meaningful dialogue for policy/plan/program improvement, and the responsibility for its 
interpretation and use lies with the reader. 


REFERENCES 

[1 K. Sørensen et al., “Health literacy and public health: a systematic review and integration of definitions and models,” BMC public 

health, vol. 12, p. 80, Jan. 2012, doi: 10.1186/1471-2458-12-80. 

[2 D. Nutbeam, “Defining, measuring and improving health literacy,” Health evaluation and promotion, vol. 42, no. 4, pp. 450—456, 

2015, doi: 10.7143/jhep.42.450. 

[3 M. K. Paasche-Orlow and M. S. Wolf, “The Causal pathways linking health literacy to health outcomes,” American Journal of 

Health Behavior, vol. 31, no. 1, pp. 19-26, 2007, doi: 10.5993/ajhb.31.s1.4. 

[4 J. A. Chehuen Neto et al., “Letramento funcional em saúde nos portadores de doenças cardiovasculares crônicas,” Ciência &amp; 

Saúde Coletiva, vol. 24, no. 3, pp. 1121—1132, 2019, doi: 10.1590/1413-81232018243.02212017. 

[5 A. Aaby, K. Friis, B. Christensen, G. Rowlands, and H. T. Maindal, “Health literacy is associated with health behaviour and self- 

reported health: A large population-based study in individuals with cardiovascular disease,” European journal of preventive 

cardiology, vol. 24, no. 17, pp. 1880-1888, Nov. 2017, doi: 10.1177/20474873 17729538. 

[6 S. A. Fleary, P. Joseph, and J. E. Pappagianopoulos, “Adolescent health literacy and health behaviors: A systematic review,” 

Journal of Adolescence, vol. 62, no. 1, pp. 116-127, 2017, doi: 10.1016/j.adolescence.2017.11.010. 

[7 S. Brangan, M. Ivanišić, G. Rafaj, and G. Rowlands, “Health literacy of hospital patients using a linguistically validated Croatian 

version of the Newest Vital Sign screening test (NVS-HR),” PloS one, vol. 13, no. 2, pp. e0193079-e0193079, Feb. 2018, doi: 

10.137 1/journal.pone.0193079. 

[8 N. D. Berkman et al., “Health literacy interventions and outcomes: an updated systematic review.,” Evidence report/technology 

assessment, no. 199, pp. 1-941, 2011. 

[9 K. Eichler, S. Wieser, and U. Brügger, “The costs of limited health literacy: a systematic review,” International journal of public 
health, vol. 54, no. 5, pp. 313—324, 2009, doi: 10.1007/s00038-009-0058-2. 

[10] N. D. Berkman, T. C. Davis, and L. McCormack, “Health Literacy: What Is It?,” Journal of Health Communication, vol. 15, no. 
sup2, pp. 9-19, 2010, doi: 10.1080/108 10730.2010.499985. 

[11] M. da P. B. Passamai, H. A. de C. Sampaio, A. M. I. Dias, and L. A. Cabral, “Letramento funcional em saúde: reflexões e 
conceitos sobre seu impacto na interação entre usuarios, profissionais e sistema de saúde,” Interface - Comunicação, Saúde, 
Educação, vol. 16, no. 41, pp. 301-314, Jun. 2012, doi: 10.1590/S1414-32832012005000027. 

[12] D. Nutbeam, “Defining and measuring health literacy: what can we learn from literacy studies?,” International Journal of Public 
Health, vol. 54, no. 5, pp. 303-305, 2009, doi: 10.1007/s00038-009-0050-x. 

[13] M. Kutner et al., “The health literacy of america’s adults: results from the 2003 national assessment of adult literacy. NCES 2006- 
483.,” National Center for Education Statistics, vol. 6, pp. 1-59, 2006. 


Int J Public Health Sci, Vol. 11, No. 4, December 2022: 1157-1166 


Int J Public Health Sci ISSN: 2252-8806 O 1165 


[14] 
[15] 
[16] 


[17] 


[18] 
[19] 
[20] 
[21] 
[22] 


[23] 


[24] 


[25] 
[26] 


[27] 


[28] 
[29] 


[30] 


[31] 


[32] 


[33] 


[34] 


[35] 
[36] 
[37] 
[38] 
[39] 
[40] 


[41] 


[42] 


[43] 


[44] 


[45] 


B. D. Weiss et al., “Quick assessment of literacy in primary care: The newest vital sign,” Annals of Family Medicine, vol. 3, no. 6, 
pp. 514-522, 2005, doi: 10.1370/afm.405. 

G. Rowlands, N. Khazaezadeh, E. Oteng-Ntim, P. Seed, S. Barr, and B. D. Weiss, “Development and validation of a measure of 
health literacy in the UK: the newest vital sign,” BMC public health, vol. 13, p. 116, Feb. 2013, doi: 10.1186/1471-2458-13-116. 
T. Kogure et al., “Validity and reliability of the Japanese version of the Newest Vital Sign: a preliminary study,” PloS one, vol. 9, 
no. 4, pp. e94582-e94582, Apr. 2014, doi: 10.1371/journal.pone.0094582. 

N. Awofeso, A. Al Zarooni, Z. A. H. Rabih, and M. Bamidele, “Health literacy measurements with the newest vital sign 
instrument among adolescents from Dubai, United Arab Emirates,” Turkish Journal of Family Medicine and Primary Care, pp. 
164-170, 2017, doi: 10.21763/tjfmpc.336147. 

D. Paiva, S. Silva, M. Severo, P. Moura-Ferreira, N. Lunet, and A. Azevedo, “Limited health literacy in portugal assessed with 
the newest vital sign,” Acta Médica Portuguesa, vol. 30, no. 12, p. 861, 2017, doi: 10.20344/amp.9135. 

J. B. VanGeest, V. L. Welch, and S. J. Weiner, “Patients’ Perceptions of Screening for Health Literacy: Reactions to the Newest 
Vital Sign,” Journal of Health Communication, vol. 15, no. 4, pp. 402—412, 2010, doi: 10.1080/10810731003753117. 

S. C. Nair, K. P. Satish, J. Sreedharan, and H. Ibrahim, “Assessing health literacy in the eastern and middle-eastern cultures,” 
BMC public health, vol. 16, p. 831, Aug. 2016, doi: 10.1186/s12889-016-3488-9. 

T. Tsubakita, N. Kawazoe, and E. Kasano, “A new functional health literacy scale for Japanese young adults based on item 
response theory,” Asia-Pacific Journal of Public Health, vol. 29, no. 2, pp. 149-158, 2017, doi: 10.1177/1010539517690226. 

L. M. Curtis et al., “Development and validation of the comprehensive health activities scale: a new approach to health literacy 
measurement,” Journal of health communication, vol. 20, no. 2, pp. 157—164, 2015, doi: 10.1080/10810730.2014.917744. 

C. Y. Tian, R. H. Xu, P. K.-H. Mo, D. Dong, and E. L.-Y. Wong, “Generic health literacy measurements for adults: a scoping 
review,” International journal of environmental research and public health, vol. 17, no. 21, p. 7768, Oct. 2020, doi: 
10.3390/ijerph17217768. 

C. A. L. and M. C. T. M. M. Mamangon, G. G. De Ocampo, D. S. Abantao, K.V. Bataga, J. F. Domingo, “Assessment of 
psychometric properties of the Health Literacy Short-Form 12 among hypertensive patients from a barangay in Manila,” 
Philippine Journal of Health Research and Development, vol. 26, pp. S7-S14, 2022. 

M. C. C. Tolabing et al., “Prevalence of Limited Health Literacy in the Philippines: First National Survey,” Health literacy 
research and practice, vol. 6, no. 2, pp. e104—e112, Apr. 2022, doi: 10.3928/24748307-20220419-01. 

J. Roberts, “Improving health literacy to reduce health inequalities,” Public Health England and UCL Institute of Health Equity, 
no. September, pp. 1-16, 2015. 

S. Dodson, S. Good, and R. Osborne, “Health literacy toolkit for low- and middle-income countries. A series of information 
sheets to empower communities and strengthen health systems,” National Network of Libraries of Medicine Southeastern/Atlantic 
Region, 2014. 

H. Weishaar, K. Hurrelmann, O. Okan, A. Horn, and D. Schaeffer, “Framing health literacy: A comparative analysis of national 
action plans,” Health Policy, vol. 123, no. 1, pp. 11-20, 2019, doi: 10.1016/j.healthpol.2018.11.012. 

D. A. Hall et al., “A good practice guide for translating and adapting hearing-related questionnaires for different languages and 
cultures,” International Journal of Audiology, vol. 57, no. 3, pp. 161—175, 2017, doi: 10.1080/14992027.2017.1393565. 

E. Anthoine, L. Moret, A. Regnault, V. Sébille, and J.-B. Hardouin, “Sample size used to validate a scale: a review of publications 
on newly-developed patient reported outcomes measures,” Health and quality of life outcomes, vol. 12, p. 176, Dec. 2014, doi: 
10.1186/s12955-014-0176-2. 

G. O. Boateng, T. B. Neilands, E. A. Frongillo, H. R. Melgar-Quifionez, and S. L. Young, “Best practices for developing and 
validating scales for health, social, and behavioral research: a primer,” Frontiers in public health, vol. 6, p. 149, Jun. 2018, doi: 
10.3389/fpubh.2018.00149. 

The Department of Health (DOH), “Immunization schedule printed on back of immunization cards,” Republic of the Philippines, 
Department of Health Kagawaran ng Kalusugan. 
https://doh.gov.ph/sites/default/files/health_promotion/IPV_Immunization_Card_Back.jpg. 

P. M. Fayers and D. Machin, Quality of Life: The assessment, analysis and reporting of patient-reported outcomes, 3rd ed., vol. 1. 
John Wiley & Sons Inc., 2016. 

UNICEF, “Routine immunization schedule for infants,” UNICEF Philippines, 2021. 
https://www.unicef.org/philippines/sites/unicef.org.philippines/files/styles/media_large_image/public/routinevaccinationsched.pn 
g?itok=tU1CNicY (accessed Nov. 23, 2021). 

P. Koršňáková, S. Dept, and D. Ebbs, “Translation: the preparation of national language versions of assessment instruments,” [EA 
Research for Education. Springer International Publishing, pp. 85—111, 2020, doi: 10.1007/978-3-030-5308 1-5_6. 

H. Taherdoost, “Validity and reliability of the research instrument; how to test the validation of a questionnaire/survey in a 
research,” SSRN Electronic Journal, 2016, doi: 10.2139/ssrn.3205040. 

S. Tsang, C. F. Royse, and A. S. Terkawi, “Guidelines for developing, translating, and validating a questionnaire in perioperative 
and pain medicine,” Saudi journal of anaesthesia, vol. 11, no. Suppl 1, pp. S80-S89, May 2017, doi: 10.4103/sja.SJA_203_17. 

F. Li and H. He, “Assessing the Accuracy of Diagnostic Tests,” Shanghai Archives of Psychiatry, vol. 30, no. 3, pp. 207-212, 
2018, doi: 10.11919/j.issn. 1002-0829.218052. 

L. Gordis, Epidemiology, 5th ed. Philadelphia: Elsevier Saunders, 2014. 

H. Placento et al., “Croatian Version of the short assessment of health literacy for spanish adults (sahlsa-50): cross-cultural 
adaptation and psychometric evaluation,” Healthcare (Basel, Switzerland), vol. 10, no. 1, p. 111, Jan. 2022, doi: 
10.3390/healthcare10010111. 

P. J. Schulz, B. Lindahl, U. Hartung, U. Naslund, M. Norberg, and S. Nordin, “The right pick: Does a self-assessment 
measurement tool correctly identify health care consumers with inadequate health literacy?,” Patient Education and Counseling, 
vol. 105, no. 4, pp. 926-932, 2022, doi: 10.1016/j.pec.2021.07.045. 

C. R. Carpenter, K. A. Kaphingst, M. S. Goodman, M. J. Lin, A. T. Melson, and R. T. Griffey, “Feasibility and diagnostic 
accuracy of brief health literacy and numeracy screening instruments in an urban emergency department,” Academic emergency 
medicine : official journal of the Society for Academic Emergency Medicine, vol. 21, no. 2, pp. 137—146, Feb. 2014, doi: 
10.111 1/acem.12315. 

C. B. Terwee et al., “Quality criteria were proposed for measurement properties of health status questionnaires,” Journal of 
Clinical Epidemiology, vol. 60, no. 1, pp. 34—42, 2007, doi: 10.1016/j.jclinepi.2006.03.012. 

T. M. Salgado et al., “Newest Vital Sign as a proxy for medication adherence in older adults,” Journal of the American 
Pharmacists Association, vol. 53, no. 6, pp. 611-617, 2013, doi: 10.133 1/japha.2013.12249. 

Department of Science and Technology - Food and Nutrition Research Institute, “Philippine Nutrition Facts and Figures: 2018 
Expanded National Nutrition Survey (ENNS),” Department of Science and Technology - Food and Nutrition Research Institute, 


Development and validation of a functional health literacy instrument in ... (Ma. Carmen C. Tolabing) 


1166 O ISSN: 2252-8806 


2020. 

[46] S.J etal., “The understanding, attitude and use of nutrition label among consumers (China),” Nutricion hospitalaria, vol. 31, no. 
6, pp. 2703-2710, 2015, doi: 10.3305/nh.2015.31.6.8791. 

[47] W. Rimpeekool, V. Yiengprugsawan, M. Kirk, C. Banwell, S.-A. Seubsman, and A. Sleigh, “Nutrition label experience, obesity, 
high blood pressure, and high blood lipids in a cohort of 42,750 Thai adults,” PloS one, vol. 12, no. 12, pp. e€0189574—e0189574, 
Dec. 2017, doi: 10.137 1/journal.pone.0189574. 

[48] C.-T. J. Lin, Y. Zhang, E. D. Carlton, and S. C. Lo, “2014 FDA health and diet survey,” Center for Food Safety and Applied 
Nutrition, Food and Drug Administration, 2016. 


BIOGRAPHIES OF AUTHORS 


Ma. Carmen Cornelia-Tolabing © ki P is a Public Health professional with 
specialization in Epidemiology. She teaches Epidemiology, Biostatistics, and Research in 
the University of the Philippines, College of Public Health. She obtained her undergraduate 
and graduate degrees in Public Health (BSPH, MPH, DrPH) with graduate specialization in 
Epidemiology from the University of the Philippines. Carmen’s research interests include 
health information system, health human resources, evaluation of public health 
programs/interventions, and health literacy. She served as Principal Investigator of the first 
National Health Literacy Survey that was completed in mid-2019. She is Vice President of 
the Asia Health Literacy Association (AHLA) and Deputy Director of the AHLA Country 
Office in the Philippines. She can be contacted at email: mctolabing@up.edu.ph. 


Kim Carmela Co © EJ P' is an epidemiologist, previously teaching epidemiology, 
biostatistics, and research at the University of the Philippines, College of Public Health. 
Currently, she is working as a public health epidemiologist supporting preparedness and 
response to health emergencies in Laos. She can be contacted at email: 
kimcarmelaco @up.edu.ph. 


Martin Aaron M. Mamangon OK P holds a Bachelor of Science degree in Public 
Health and is currently pursuing Doctor of Medicine at the University of the Philippines 
Manila. He worked as a research assistant in projects related to health literacy and was 
inducted as a member of the Royal Society for Public Health. He can be contacted at email: 
mmmamangon @up.edu.ph. 


Int J Public Health Sci, Vol. 11, No. 4, December 2022: 1157-1166 


